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Abstract 

We compute spectra of symmetric random matrices describing graphs with general mod- 
ular structure and arbitrary inter- and intra-module degree distributions, subject only to 
the constraint of finite mean connectivities. We also evaluate spectra of a certain class of 
small-world matrices generated from random graphs by introducing short-cuts via additional 
random connectivity components. Both adjacency matrices and the associated graph Lapla- 
cians are investigated. For the Laplacians, we find Lifshitz type singular behaviour of the 
spectral density in a localised region of small |A| values. In the case of modular networks, we 
can identify contributions local densities of state from individual modules. For small-world 
networks, we find that the introduction of short cuts can lead to the creation of satellite 
bands outside the central band of extended states, exhibiting only localised states in the 
band-gaps. Results for the ensemble in the thermodynamic limit are in excellent agreement 
with those obtained via a cavity approach for large finite single instances, and with direct 
diagonalisation results. 



1 Introduction 

The past decade has seen a considerable activity in the study of random graphs (see, e.g. p] , or 
OElll] for recent reviews), as well as concurrent intensive studies in spectral properties of sparse 
random matrices [21 [5l El d E] , the latter providing one of the key tools to study properties of the 
former. Moments of the spectral density of an adjacency matrix describing a graph, for instance 
give complete information about the number of walks returning to the originating vertex after 
a given number of steps, thus containing information about local topological properties of such 
graphs. Spectral properties, specifically properties of eigenvectors corresponding to the largest 
eigenvalue of the modularity matrices of a graph and of its subgraphs - matrices closely related 
to the corresponding adjacency matrices - can be used for efficient modularity and community 
detection in networks [9], and so on. Much of this activity has been motivated by the fact that 
a large number of systems, natural and artificial, can be described using network descriptions of 
underlying interaction patterns, and the language and tools of graph theory and random matrix 
theory for their quantitative analysis. 

Though the study of spectral properties of sparse symmetric matrices was initiated by Bray 
and Rodgers already in the late 80s [10^ lllj . fairly complete analytic and numerical control 
over the problem has emerged only recently [12^ [T3] , effectively using generalisations of earlier 
ideas developed by Abou-Chacra et al. [14] for Bethe lattices. Analytical results for spectral 
properties of sparse matrices had typically been based either on the single defect or effective 
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medium approximations (SDA, EMA) [151 [13 El [12], or were restricted to the limit of large 
average connectivity [181 [IH| • Alternatively, spectra for systems with heterogeneity induced by 
scale- free or small- world connectivity [HI [20] , or as a result of an explicitly modular structure 
|21j were obtained through numerical diagonalisation. Analytical results for spectra of modular 
systems [22] and for systems with topological constraints beyond degree distributions [23j are 
still very recent. 

The purpose of the present paper is to expand the scope of [22j in two ways, (i) by providing 
spectra of random matrices describing graphs with general modular structure and arbitrary 
inter- and intra-module degree distributions, subject only to the constraint of finite mean con- 
nectivities, and (ii) by computing spectra for a class of small- world systems, constructed as 
regular random graphs with an additional connectivity component providing long-range inter- 
actions and thus short-cuts. The connection between these two seemingly different problems is 
mainly provided by the close similarity of the methods used to study these systems. 

Our study is motivated by the fact that modularity of systems, and thus networks of interactions 
is a natural property of large structured systems; think of compartmentalisation in multi-cellular 
organisms, sub-structures and organelles inside cells and the induced structures e.g. in protein- 
protein interaction networks, or think of large corporates with several subdivisions, to name but 
a few examples. 

In Sect. 12. ll we introduce the type of multi- modular system and the associated random matrices 
we are going to study. A replica analysis of the problem is described in Sect. 12. 2^ with (replica- 
symmetric) self-consistency equations derived in Sect. 12.31 Sect. [3] introduces a class of small- 
world networks generated from (regular) random graphs by introducing short-cuts via a second, 
long-range connectivity component, and briefly describes the rather minimal modifications in 
the theoretical description needed to analyse those systems as well. In Sect. |4] we present a 
selection of results. Our main conclusions are outlined in Sect. [5l 



2 Modular Systems 

2.1 Multi-Modular Systems and Random Matrices Associated with Them 

We consider a system of size N which consists of m modules A/"^, fi = 1, . . . ,m. We use A'^ to 
denote the size of the module M^, and assume that each module occupies a finite fraction of the 
entire system, A'^ = f^N, with f\i>0 for all /i, and 

m 

Details of the modular structure are encoded in the N x N connectivity matrix c = (q^), 
whose matrix elements Cij describe whether a link between nodes i and j exists (cjj = 1) or not 
{cij = 0). To each site site i of the system, we assign a connectivity vector ki = (A;^), whose 
components 

K = E (2) 

give the number of connections between site i and (other) sites in module u. The ki are taken 
to be fixed according to some given distribution which we assume to depend only on the module 
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to which i belongs, and which has finite means 



(fef)^ = c'^^ i e AT^ (3) 

for the components, but is otherwise arbitrary. We use (. . .)^ to denote an average over the 
distribution of coordinations for vertices in module A/^^. Consistency required by symmetry 
entails c'^^'/N^ = d'^'/N^, or alternatively f^c^''' = /^c'^^. 

Starting from the modular structure defined by the connectivity matrix c, we consider two 
types of random matrix inheriting the modular structure. The first is defined by giving random 
weights to the links, thereby defining random matrices M of the form 

Mij = CijKij , (4) 

where we assume that the statistics of the Kij respects the modular structure defined by c in 
that it only depends on the modules to which i and j belong. The second is related to the first 
by introducing zero row-sum constraints, resulting in matrices of the form 

Lij — CijKij 6ij ^ ^ CikKik • (5) 

k 

In the special case Kij = const., one recovers the connectivity matrices themselves, and the 
discrete graph Laplacians respectively. 

We note in passing that it is possible to include extensive intra-module and inter-module con- 
nections in addition to the finite connectivity structure described above as in [22], but we have 
decided not to do so here. 

The spectral density of a given matrix M can be computed from its resolvent via 

Pm[\) = lim ilmTr[AeI- M]"^ 
e\0 vr 

= lim — Im^lndetfAel-Ml"^/^ , (6) 

e\0 Nn OA 

in which = X — ie, and the inverse square root of the determinant is obtained as a Gaussian 
integral. We are interested in the average spectral density obtained from ([6]) by taking an average 
over the ensemble of matrices considered, thus in 



-2 d 
p(X) = lim — — Im-— - ( In 



f YJ dui 



^ Ui [Xe6ij - Mij] Uj 



(7) 



where angled brackets on the r.h.s denote an average over connectivities {cij} and weights {Kij} 
of the non-vanishing matrix elements. For the ensembles considered here the spectral density is 
expected to be self-averaging, i.e. that ([6]) and ([7]) agree in the thermodynamic limit N — )• oo. 

The distribution of connectivities is taken to be maximally random compatible with the distribu- 
tion of coordinations. Vertices i € Af^ and j G N'u are connected with a probability proportional 
to kj^kj. This can be expressed in terms of a fundamental distribution p^'^ of connectivities 
(between sites i £ and j € AC) 
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as 



Pic\{k^}) = U l^rC^Mc.^c^X n {n Up'o''ic^J)Sc..,cM 

xiin (n^^.w.c.„.r| (9) 

where is a normalisation constant, and the Kronecker-deltas enforce the coordination distri- 
butions. 

The average of the logarithm in ([7]) is evaluated using replica. 

^ = hm ^Im|- lim - ln{Z^) , (10) 

with 

= / n <^^p I -i E E - ^^^i 1 (11) 

Here a = 1 , . . . , n enumerates the replica. We initially describe the process for matrices of type 
([U, and briefly mention the modifications to treat matrices of type ^ with zero row-sum 
constraints later. 

2.2 Disorder Average 

To evaluate the average, one uses integral representations of the Kronecker-deltas 

'5E,,^c,„.r= /'^^e^<(^^^-^-^-'=r) (12) 



27r 



The average of the replicated partition function for matrices of type becomes 

(^«) - ^ / n ^ n »p { -i^' ? - ' E E 



iu ia y I \ ia l^u i(^N^ 

> ; ( ( exp <j iK > ; U^aUja \ \ 



gi^r+i^; _ 1 ] V (13) 



where ( . . . represents an average over the Kij distribution, connecting vertices i G M^j, and 
j e My, which is as yet left open. 

Decoupling of sites is achieved by introduction of the replicated 'densities' 
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and their (p integrated versions 

= / dip p^^'^\u,^y^ . (15) 



It turns out that only the latter, and their conjugate densities p^^'^^ are needed, and Eq. (jl3p 
can be expressed as a functional integral 

^^n) = j WiVp^^^W"^} exp {N [Gi + G2 + G3]} , (16) 



with 



^1 = ^Ev'^'(^/d/'^'''^(")d'«^'''^(^)(^^p{^^E^^^^ (17) 

= -i^/M/dwp('^'^)(ti)p(^-)(ti) (18) 



G 



Here we have exploited the symmetry relation f^c^^ = fuc'^^, introduced the short-hand nota- 
tions dp^^'^\u) = du p^f^'^\u) for integrals over densities where appropriate, and (. . .)^ in (|19|) 
for the average over the distribution of coordinations of sites in module M^. 

2.3 Replica Symmetry and Self-Consistency Equations 

The functional integral (jl6p is evaluated by the saddle point method. As in the extensively cross- 
connected case, the saddle point for this problem is expected to be both replica-symmetric, and 
rotationally symmetric in the replica space. In the present context this translates to an ansatz 
of the form 

exp [ - f u2] 



p(^-^Hu) = pr/d.(^'^)(^)n' 

a 

p^'^\u) = pr/d^(-)(^)n^^4i^' 



Z{u:) 



with normalisation constants 



Z{ijj) = j duexp ""^""^ = \Jl'K jijj , (21) 

i.e. an uncountably infinite superposition of complex Gaussians (with Re[a;] > and Rep] > 0) 
for the replicated densities and their conjugates |121 122j. The Pq^^\ Pq^'^^ in the expressions for 
pC/^f) and p^'''^) in (j2U|) are determined such that the densities vr^^'^^ and ^T^^^'^^ are normalised. 

This ansatz translates path-integrals over the replicated densities p^^^'^^ and p^^'^) into path- 
integrals over the densities vr^^'^-' and tt^^'^\ and integrals over the normalisation factors p\^'^^ 
and Pq^\ giving 

^^n) = ^ I ll{V7r(^''^Vr^(^''^dpi^'^dpi^''^} exp {N [G, + G2 + G3]} , (22) 
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with 

Gi 



+np[^''\^^^^ / d7r('^'^)(a;)d7r(^'^)(a;')( In 



Go 



G. 



Z2{u},u}', K) 
Z{u)Z{uj') 

l + n I d7r(^'^)(a;)d7r('^'^)(a;)ln 



fJ.U-1 



/ ^l 



Z{lo)Z{uj) 
Infe'^l) )+n( I {d7r(^)}fcln 



{Z}k 



(23) 
(24) 
.(25) 



Here, we have introduced short-hand notations for products of integration measures: {dyr^^^lfe 
111^11^^=1 '^'^^'^'^'^ i'^ei^)^ products of partition functions: {Z}^ = Y[uY['e„=i ^{'^ii^)^ ^'^d for c 



sums: Sfe (J = Sf^=i '^ii, • Furthermore, we have introduced the partition functions 

du 



Zx{T.kio) 



exp 



Z2{u},u>',K) 



i 

dudv exp 



1/2 



-- I uu^ + iJv^ — 2iKuv I 



2tt 



(26) 
(27) 



The normahsation constant M in (jl3p is given by 



exp 



27r 



Site decouphng is achieved by introducing 



l)-iEE^rA:.^ 



Po 



(pu) 



— y e^^^ 



(28) 



(29) 



and a corresponding set of conjugate order parameters to enforce these definitions. Note that for 
reasons to become clear below, we use a notation previously employed for normalisation factors 
of replicated densities. This duplication is intentional, as it reveals terms in the numerator and 
denominator of p2p exhibiting the same exponential scaling in when evaluated at the saddle 
point, and hence cancel. We get 



n o_ fr' exp { N 



fll/ 



pu 



In A;''! 



(30) 
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which is also evaluated by the saddle point method. 

Before we derive the saddle point conditions, we note that the functions Gi, G2 and G3 in the 
numerator of (j22[) contain both 0(1) and 0{n) contributions in the n — )• limit, such that the 
integrand in the numerator contains both terms that scale exponentially in N and in Nn. The 
denominator (M), however, scales exponentially in A'^. Since the ratio (j22p scales exponentially 
in Nn, the 0(1) contributions to Gi, G2 and G3 should cancel with those of at the saddle 
point, which is indeed the case. 

Evaluating first the stationarity conditions for G = Gi + G2 + 6*3 at 0(1) gives 



and 



in 



from which we obtain 



(31) 



W Po 



and 



Po Po 



1 



(32) 



The stationarity conditions for the saddle point of M are exactly the same. Since ()32p exhibits 
the gauge-symmetry 



Po 



(33) 



the correct scaling in Nn is obtained, provided that the same gauge is adopted in both the 
numerator and the denominator of (|22p . The saddle point contribution is determined from 
stationarity conditions with respect to variations of the tt^^'^^uj) and the tt^^'^\lu). 

Using (]32p . the stationarity conditions for the Tr^^^'^\u) read 



d7r'^^)(cj)ln 



Z{u} + uj) 
Z{Cj)Z{uj) 



(in 



Z2{uj,uj',K) \ 
Z{uo)Z{lo') I 



+ 



(34) 



with (^^J^l, a Lagrange multiplier to enforce the normalisation of t^'^^^^ . 
The stationarity conditions for the %'^^^^{Gj) are 

Z{Gj -|- a; 



lS] In 



Z(Gj)Z{yj) 



{d7r(^)}fc\,. In 



Za(w -I- SfcVfc" 

{-2'}fc\A:'' 



bJ] 



+ 



'liv 



(35) 



where {d7r^^-'}fe\fc^ denotes the product {dir'-'^-'Ifc of integration measures from which di:^^^^ (Cj\^v') 
is excluded, i.e. the product {d^(^')}fc\fe. = n^^c^.) 11^=1 d7r(^^)(c2;,,) x d7r(^-)(^i,J. Anal- 

ogous constructions apply to the product and the sum T,u\k'' ^1 and 4>^y is the Lagrange 

multiplier to enforce the normalisation of the t^'^^^'^ (Gj) . 

Following [Ml [25], the stationarity conditions for 'n'^^^^iyj) and t^^^^^{Cj) are rewritten in a form 
that suggests solving them via a population based algorithm. In the present case we get \yi\ [22] 



d^(^'^)(cj')(<^(w- A(cj',i^)|) 



vr 



(^) 



(5 



(36) 
(37) 
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with 

n{uj', K) = — , n)^^^,^ = iXe + Co . (38) 

The spectral density is obtained from (l6|); note that only the explicit A dependence in G3 in 
(|25p contributes. We obtain a formal result analogous to that obtained earlier for homogeneous 
systems, or for cross-connected modules of equal size with Poisson distributions of inter-module 
coordinations [22], 

p(A) = iRelim[j]^ri'^)] , (39) 



where 



/"{d7r(^)}fc ) . (40) 



Here (. . average w.r.t. the Gaussian weight in terms of which Z;^(Sfc w) is defined. 

As explained in detail in [12], an evaluation of (|39p. (j40p via sampling from a population will 
miss the pure-point contributions to the spectral density. In order to see these, a small non-zero 
regularizing e, which amounts to replacing (5-functions by Lorentzians of width e must be kept, 
resulting in a density of states which is smoothed at the scale e. A simultaneous evaluation 
of (j40p for non-zero e and in the e \ 0-limit then allows to disentangle pure-point and and 
continuous contributions to the total density of states ([39]) . 

If we are interested in spectra of the generalised graph Laplacians L defined by ([5]) instead of 
the weighted adjacency matrices M, we need to evaluate 




+E^ E E ( (-p{-4E(''.— («) 



A^i. ^ \ \ I 2 



instead of (|13p , the only difference being the translationally invariant form of the interactions in 
the present case0. The structure of the theory developed above and the fixed point equations 
()36p . (I37p remain formally unaltered, apart from a modification of the definition of ^2(01,0;', K) 
of ()27p due to the modified interaction term 

Z2{u:,Ljo',K) = J dudv exp —-^u'^ + ijj'v^ + iK{u — v)'^^ 

= Z{u' + \K)zL + ^^^\ , (42) 



^There is a typo, a missing minus-sign in front of the translationally invariant interaction term in the last 
unnumbered Eq. on p 15 of [12j . 
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here expressed in terms of the normahsation constants Z{-) of (121 p . As aheady noted in [12j this 
only requires a modified definition of Cl{uj',K) in ([38|) . viz 

Ki / 

^('^''^) = T^-7' (43) 
A — IW 

but leaves the the self-consistency equations otherwise unchanged. 



2.4 Cavity Equations for Finite Instances 

Rather than studying the ensemble in the thermodynamic limit, one can also look at large but 
finite single instances. The method of choice to study these is the cavity approach [T3], for 
which the additional structure coming from modularity does not cause any additional compli- 
cation at all, and the original set-up [13] applies without modification, apart from that related 
to generating large modular graphs with the prescribed statistics of inter- and intra-module 
connectivities. 

Equations (11) of [13], when written in terms of the notation and conventions used in the present 
paper translate into 

= ^ , = + E , (44) 

eedj\i 



in which dj denotes the set of vertices connected to j, and dj \ i the set of neighbours of j, 
excluding i. 

These equations can be solved iteratively {131 even for very large system sizes, showing fast 
convergence except at mobility edges, where we observe critical slowing-down. The density of 
states for a single instance of a matrix M is obtained from the self-consistent solution via 



£\0 N-K 

3 



(45) 



with 

,(i) 



voj =\\, + Y^ 4 • (46) 
The modifications required to treat generalised graph Laplacians are once more straightforward. 



3 Small- World Networks 

Small-world networks can be constructed from any graph, by introducing a second, random 
connectivity component which introduces short-cuts in the original graph, as long as the second 
component is sufficiently weakly correlated with the first. 

The standard example is a closed ring, with additional links between randomly chosen pairs 
along the ring. Alternatively one could start with a regular random graph of fixed coordination 
ki = 2 (this gives an ensemble of loops with typical lengths diverging in the thermodynamic limit 
N — )■ oo), then introducing a second sparse connectivity component linking randomly chosen 
vertices of the original graph. 
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Clearly the original graph need not be a ring; it could be a d dimensional lattice, a Bethe lattice, 
or a (regular) random graph of (average) connectivity different from 2, and one could introduce 
several additional random connectivity components to create short-cuts. 

In what follows, we look at (finitely coordinated) random graphs with several connectivity com- 
ponents between the vertices of the graphs. The set-up is rather close to that of multi-modular 
systems as described above, except that there is only a single module, having m connectivity 
components linking the vertices of this single module. 

The formal structure of the theory is therefore very similar to that described earlier and we just 
quote the final fixed point equations, and the result for the spectral density, without derivations. 

We need to solve the following set of fixed point equations 

n'-'^Xu) = j d^'^''\j)(5{uj -(l{uj',K)^ (47) 

7r('^)(u;) = j {d^lfcVfc-"^ - ^k\k-^) ^ (48) 

with 

n{uj', K) = — , ilfcU- = + SfcVfc. LJ . (49) 

UJ 

where now {■ ■ ■)y in (j47p denotes an average over the weight distribution of the z/-th coupling 
component {-fCj-J^}, and the average (...) in (I48p is over the distribution of m-dimensional coor- 
dinations ki = (fef), with {k^) = . The (average) spectral density is then given by 

p{\) = -Re hm ( / {d^lfc .. \ . (50) 

Were one to look at the graph Laplacian for this type of small-world network, rather than at 
weighted) adjacency matrices one would once more only have to substitute (j43p for $7 in (I49p . 
as discussed in for the multi-modular case above. 



4 Results 

4.1 Modular Systems 

For the multi-modular systems, there are clearly far too many possible parameters and parameter 
combinations to even begin to attempt giving an overview of the phenomena one might see in 
such systems. Hence, we restrict ourselves to just one illustrative example chosen to highlight how 
the total density of states in different parts of the spectrum may be dominated by contributions 
of local densities of states of specific sub-modules. 

We present a system consisting of three modules, with fractions /i = 1/2, /2 = 1/3, and 
/s = 1/6 of the system respectively. Modules 1 and 3 have fixed intra-modular connectivities 
with coordinations 3 and 2 respectively, while module 2 has Poisson connectivity with average 
2. Inter-module connectivities are all Poissonian with averages c^^ = 1 and c^^ = c^^ = 1/2 
(c^^, and c?"^ follow from the consistency requirements). Non-zero couplings are chosen bi- 
modal ±l/\/cj with q = "^^i^ f^j.c^'^ apart from intra-module couplings in modules 1 and 3, 
which have values of ±l/2^/c^ and ±2/1/0^ respectively. 
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Figure 1: (Colour online) Spectrum of the three- module system described in the main text 
(red full line), along with its unfolding according to contributions of local densities of states 
contributed by the three sub-modules as suggested by Eq (39) (green long dashed: module 1, 
blue short dashed: module 2, and magenta dot-dashed: module 3). Ensemble results are displayed 
together with the corresponding results for a single instance of size = 64, 000. The former 
are plotted on top of the latter, so colour coded lines for the finite instance results (light blue: 
module 1, yellow: module 2, black dashed: module 3, and light-red dashed for the total DOS) 
remain basically invisible due to the nearly perfect match. 

Figure 1 shows the results for this system. We observe that the central cusp at A = and the 
5-function contributions to the total density of states at A = and at A ~ ±0, 463 essentially 
originate from module 2 (with Poisson connectivity of average coordination 2); a regularizing 
e = 10~^ has been used to exhibit the (5-function contributions. The humps at the edges of the 
spectrum mainly come from module 3 with the fixed coordination 2, whereas the shape of the 
shoulders at intermediate A values are mostly determined by the largest module 1 with fixed 
coordination 3. Note that there are small tails of localised states for |A| > 2.415. 

We found results computed for a single instance of this modular structure containing A'^ = 
60, 000 vertices to be virtually indistinguishable from the ensemble results, except for finite 
sample fluctuations in the extreme tails where the expected DOS becomes too small to expect 
more than a few eigenvalues for the = 60, 000 system. 

The (5-peaks at A ~ ±0, 463 originate from isolated dimers as part of module 2 which remain 
isolated upon cross-linking the different modules. For the three module system in question, the 
weight a2 of each of the 5-peaks can be shown to be ^e~^ ~ 5.6 10^^ in the thermodynamic 
limit, compatible with a rough estimate of a2 = (5=bl) 10~^ from our numerical ensemble results. 
We note in passing that pure-point contributions to the spectral density would be generated by 
many other finite isolated clusters; the ones with the next highest weight would be generated 
by isolated open trimers, but these are more than an order of magnitude less likely to occur, so 
that we have not picked them up at the precision with which we have performed the A scan in 
Fig. 1. 
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4.2 Small- World Networks 



The small- world networks we consider here have a small fraction of long-range connections added 
to a regular random graph of fixed coordination 2. The system without long-range interactions 
is effectively an infinite ring; it can be diagonalised analytically; for couplings of unit strength it 
has a band of extended states for |A| < 2, and the density of states exhibits the typical integrable 
van Hove sing ularity p{X) ~ | |A| -2\'''^ of a one-dimensional regular system. 

When a small amount of weak long-range interactions is introduced into the system, this central 
band will initially slightly broaden, and the van Hove singularity gets rounded (the integrable 
divergence disappears). As the strength of the long-range connections is increased, the central 
band is widened further. At the same time the density of states acquires some structure, which 
becomes more intricate, as the strength of the long-range interactions is increased, including 
side-peaks which themselves acquire sub-structure, and typically a depression of the DOS near 
the location of the original band edge. This depression deepens with increasing strength of 
the long-range interactions, and eventually becomes a proper band-gap, which we find to be 
populated only by localised states. Further increase in interaction strength introduces ever more 
structure, including depressions in the DOS inside side-bands which in turn develop into proper 
band gaps. 

Figure 2 shows a system for which the average additional long-range coordination is c = 0.5, 
so that long-range interactions are associated with fewer than half of the nodes on the ring. 
The figure displays the central region of the spectrum for a range of interaction strengths of the 
long-range couplings, which exhibit increasing amounts of structure with increasing interaction 
strengths. 



0.1 



0.01 




Figure 2: (Colour online) Central part of the spectrum the small-world system described in the 
text. The four curves correspond to long-range interactions of strengths J = 0.1 (red full line), 
J = 0.5 (green long dashed), J = 1.0 (blue short dashed), and J = 2.0 (magenta dot-dashed). 

Figure 3 shows the entire spectrum of this system at J = 5, and separately exhibits the con- 
tribution of the continuous spectrum. Now 4 distinct separate side bands of continuous states 
can clearly be distinguished on each side of the central band, with proper band gaps (filled with 
localised states) between them. 
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The spectrum shown in Figure 3 displays structure at many levels. To mention just two of the 
more prominent ones: the original edge of the central band develops a sequence of peaks which 
extends into the localised region. Side-bands too acquire multi-peak structures, with individual 
peaks exhibiting further sub-structure. 

Subject to limitations of computational power, our algorithm is able to exhibit these structures 
to any desired level of accuracy, though in some regions — predominantly at band edges — our 
data for the continuous DOS remain somewhat noisy; we suspect that in such regions there is 
a set of localised states that becomes dense in the thermodynamic limit, which is responsible 
for this phenomenon. Also, we have a localisation transition at every band-edge which may 
well induce critical slowing down in the population dynamics algorithm by which we obtain 
spectral densities. Quite possibly because of this, finite population-size effects in the population 
dynamics are much stronger in the present small-world system than in the simpler systems 
without side-bands studied before [l2l [TSj [22] . 

We have attempted to verify the localisation transitions using numerical diagonalisation and 
computations of inverse participation ratios [26f \27\ in finite instances of increasing size, but the 
convergence to asymptotic trends is extremely slow. Although we have gone to system sizes as 
large as = 3200 for this system, the numerical results, while compatible with those derived 
from our population dynamics algorithm, are still not forceful enough to strongly support them. 
These aspects clearly deserve further study. In this respect a recent result of Metz et al. [28], 
who managed to compute IPRs within a population dynamics approach, could well provide the 
method of choice to clarify the situation, though we have not yet implemented their algorithm. 
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Figure 3: (Colour online) Spectrum of the small-world system with c = 0.5 at J = 5, showing 
both the DOS of the extended states (green long dashed line), and the total DOS including 
contributions from localised states (red full line). A regularizing e = 10~^ has been used to 
exhibit the latter. 

4.3 Graph Laplacians 

From a dynamical point of view. Graph Laplacians ([5]) are in many ways more interesting than 
the corresponding connectivity matrices ([4]), as they could be used to analyse e.g. diffusive 
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transport on graphs, to give vibrational modes of structures described by these graphs, or to 
define the kinetic energy component of random Schrodinger operators. We have accordingly 
also looked at spectra of the graph Laplacian corresponding to the small-world type structures 
discussed in the previous section. 

For the regular random graph of fixed coordination 2, the spectrum of the graph Laplacian is 
just a shifted version of the spectrum of the connectivity matrix. As for the latter, by adding 
a small amount of weak long-range interactions this translated band initially broadens slightly, 
and the van Hove singularities disappear. More or stronger long-range interactions do, however, 
not appear to create much structure in the initial band. The tails at the lower band edge do 
acquire structure, and eventually develop proper band-gaps, populated only by localised states, 
much as for the connectivity matrix. 

Figure 4 shows the spectrum of the graph Laplacian for a small-world system with the same 
parameters as in Fig. 3. We recognise a main band of extended states for —5.59 ^ A < —0.037 
and four side bands, two of which are very narrow; they are centred around A ~ —7.2 and 
A ~ —7.3, and are barely distinguishable as separate bands on the scale of the figure. Although 
the data for A < —20 appears to look noisy, the fine structure in this region of the spectrum 
is actually accurate; as shown in the inset, we found them to be very well reproduced by high 
precision exact diagonalisation of an ensemble of 10^ matrices of size 1600 x 1600, using a fine 
binning (5000 bins across the entire spectrum, thus A A ~ 8 10~^), to achieve sufficient resolution 
of details. 

The appearance of several bands of extended states, separated by gaps which are populated 
only by localised states implies that transport processes such as diffusion will exhibit several 
distinct time-scales for such systems. Given the way in which the system is constructed, the 
appearance of two time-scales would not be surprising, as diffusion takes place both along the 
ring and via short cuts. The fact that there are several such time scales would not seem obvious, 
though. 

Another feature which becomes apparent only by zooming into the region of very small |A| is 
the appearance of a mobility edge at Ac ^ —0.037 and a region of localised states for A > Ac. The 
behaviour of the spectral density in the localised region Ac < A < shows singular Lifshitz type 
behaviour [29j. For systems with a range of different parameters, both for the average number 
c of long-range connections per site, and for their strength J, we find it to be compatible with 
the functional form 

p(A)^aexp(-6/|Ap/3) , (51) 

with a and b depending on c and J. For the c = 0.5, J = 5 system shown in Fig. 4 we have 
a = 4.0 lb 0.1 and h = 0.49 it 0.003. Three parameter fits which attempt to determine the 
|A| power in the exponential of (I5ip do give powers slightly different from 2/3 at comparable 
values of reduced x^i but the uncertainties of individual parameters are much larger. It may 
be worth mentioning that we have observed similar Lifshitz tails also for Laplacians of simple 
Poisson random graphs, both below and above the percolation transition, and for Laplacians 
corresponding to modular random graphs such as the one studied in Sect 4.1. 

5 Conclusions 

We have computed spectra of matrices describing random graphs with modular or small-world 
structure, looking both at connectivity matrices and at (weighted) graph Laplacians. Spectra 
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Figure 4: (Colour online) Spectrum the graph Laplacian for a small-world system with c = 0.5 
at J = 5, showing both the DOS of the extended states (green long dashed line), and the total 
DOS including contributions from localised states (red full line), regularized at e = 10^^. The 
inset compares the population dynamics results for the total DOS (red full line) with results of 
direct numerical diagonalisation (blue short dashed line) in the range —25 < A < —22. 



are evaluated for random matrix ensembles in the thermodynamic limit using replica, and for 
large single instances using the cavity method. We find excellent agreement between the two 
sets of results if the single instances are sufficiently large; graphs containing N = 0(10'* — 10^) 
vertices are typically required to achieve agreement with relative errors below 10~^. The ensemble 
and single instance results are in turn in excellent agreement with results of direct numerical 
diagonalisations, though averages over many samples are required for the latter due to the 
comparatively moderate sample sizes that can be handled in the direct diagonalisation approach. 

For a multi-modular system we have seen by way of example, how the total density of states in 
different parts of the spectrum may be dominated by contributions of local densities of states 
of specific sub-modules. The ability to identify such contributions may well become a useful 
diagnostic tool in situations where one needs to study the topology of modular systems for 
which plausible null-models of their compositions are available. 

For small-world systems, we have seen how the introduction of short-cuts in a regular graph 
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Figure 5: (Colour online) Lifshitz tail for small |A|. Shown are the band edge of the extended 
states (green long dashed line), the total DOS including contributions from localised states (red 
full line), and ([5T]) (blue short dashed), based on a fit of the data in the interval —0.035 < A < 
-0.0075. 



adds structure to the spectrum of the original regular random graph from which the small- 
world system is derived. Depending on parameters, this may include the possibility of having 
one or several satellite bands of extended states separated from the original band by gaps that 
are populated only by localised states. Whenever this happens for (weighted) graph Laplacians 
this implies the introduction of different time-scales for diffusive transport described by these 
Laplacians. 

For graph Laplacians we typically observe a region of localised states at small |A| where the 
density of states exhibits singular Lifshitz type behaviour. We note that the existence of a small 
|A| mobility edge implies that these systems will exhibit a finite maximum relaxation time for 
global diffusive modes though there is no corresponding upper limit for the relaxation times for 
local modes. 

We iterate that our methods are completely general concerning the modular structure of the ma- 
trices. Concerning connectivity distributions, the only requirements are that they are maximally 
random subject only to the constraints coming from prescribed degree distributions. Modular 
graphs with additional topological constraints beyond degree distributions could be handled by 
suitably adapting the techniques of [23\ . 
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